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This listing of claims will replace all prior versions, and listings, of claims in the application:) 
Listing of Claims: 

1 (original): A system for receiving audio input comprising: 

a display for displaying electronic information; 
an audio input receiving audio content; and, 

a processor for associating said received audio content with said displayed electronic 
information. 

2 (original): The system according to claim 1, wherein said audio content is in the form of audio 
clips. 

3 (currently amended): The system according to claim 1, wherein said processor further 
associating associates at least one property with said audio content and wherein said audio 
content is randomly accessible based on said at least one property. 

4 (original): The system according to claim 3, further comprising: 

a storage for storing said audio content with said at least one property. 

5 (original): The system according to claim 1, further comprising: 

an input receiving a user's input, 

wherein said processor starts recording audio content from said audio input in response to 
said user's input. 

6 (original): The system according to claim 1, wherein said processor includes a voice activated 
recording system for recording said audio content. 

7 (original): The system according to claim 6, wherein said voice activated recording system 
records when said audio content exceeds a predetermined threshold. 
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8 (original): The system according to claim 6, wherein said voice activated recording system 
records when a known user's voice is detected in said audio content. 

9 (original): The system according to claim 1, wherein said processor controls said display to 
indicate that audio content is associated with said displayed electronic information. 

10 (currently amended): A system for playing audio content, said system comprising: 

a display for displaying electronic information; 

a storage for storing audio content, said audio content including properties and having 
keen- beinR associated with said displayed electronic information; 

an output for outputting at least some of said audio content with- responsive to navigation 
of said displayed electronic information; and 

a processor for controlling said display, said storage and said output. 

11 (currently amended): The system according to claim 10, wherein said audio content are 
includes audio clips. 

12 (original): The system according to claim 10, wherein said audio content is randomly 
addressable based on said properties. 

13 (original): The system according to claim 12, wherein said storage is a database. 

14 (original): The system according to claim 10, further comprising: 

an input for receiving a user's input, 

wherein said output outputs at least some of said audio content in response to receiving 
said user's input. 

15 (original): The system according to claim 10, further comprising: 

an input for receiving a user's input, 



Page 11 of 23 



Appln.No.: 09/768,813 
Amendment dated December 8, 2004 
Reply to Office Action of September 1, 2004 

wherein said processor searches properties of said stored audio content in response to 
said user's input. 

16 (original): The system according to claim 15, wherein the output of said processor is sent to 
said display to display an indication of the search results. 

17 (original): The system according to claim 15, wherein the output of said controller is sent to 
the output for playing audio content with properties matching the search results. 

18 (original): The system according to claim 10, wherein said processor retrieves all audio 
content associated with said electronic information when said electronic information is accessed. 

19 (original): The system according to claim 10, wherein said processor outputs selected audio 
content to be played through said output when a page of said electronic information is displayed. 

20 (original): The system according to claim 19, wherein said processor automatically plays said 
selected audio content when said page is displayed. 

21 (currently amended): The system according to claim 10, further comprising: 

a communication link to transmit said audio content with its prop e rti e s . 

22 (currently amended): The system according to claim 21, further comprising: 

a network connected to said communication link for receiving said audio content-with 
properti e s , said network being accessible by other users. 

23 (currently amended): The system according to claim 21, further comprising: 

a receiving device of another user for receiving said audio content with properti e s , said 
receiving device receiving said audio content through one of a wired or wireless interface. 

24 (original): The system according to claim 22, wherein said network further processes said 
audio content. 
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25 (original): The system according to claim 22, wherein said network includes a database for 
storing said audio content. 

26 (original): The system according to claim 22, wherein said network receives audio content 
without receiving said electronic information associated with said audio content. 

27 (original): A user interface for displaying electronic information to a user comprising: 

a first display portion for displaying a portion of a document; and 
a second display portion for displaying a graphical indication that said document includes 
an audio annotation associated with said displayed portion of said document. 

28 (original): The user interface according to claim 27, further comprising: 

a third display portion for displaying a non-audio annotation. 

29 (original): The user interface according to claim 27, further comprising: 

a third display portion for displaying an indication that said audio annotation is being 
recorded or played back. 

30 (original): The user interface according to claim 27, further comprising: 

a third display portion for displaying one of a document tape or a master tape. 

31 (original): The user interface according to claim 27, further comprising: 

a third display portion for receiving a user input of a property or properties of said audio 
annotation. 

32 (original): The user interface according to claim 27, wherein said audio annotation is 
recordable by said user. 

33 (original): A process for recording an audio annotation comprising the steps of: 

displaying electronic information; 
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receiving a user input; 

recording an audio annotation in response to said user input; and 

associating said audio annotation with properties including a displayed portion of said 
electronic information. 

34 (original): The process according to claim 33, further comprising the step of: 

storing said audio annotation prior to the association of said audio annotation with said 
displayed portion. 

35 (original): The process according to claim 33, further comprising the step of: 

storing said audio annotation after the association of said audio annotation with said 
displayed portion. 

36 (original): The process according to claim 33, wherein said recording step records all ambient 
sounds. 

37 (original): The process according to claim 33, wherein said recording step records only 
sounds above a predetermined threshold. 

38 (original): The process according to claim 37, wherein said recording step records only a 
specific user's voice. 

39 (original): The process according to claim 33, further comprising the step of: 

associating additional properties with said audio annotation at the start of recording of 
said audio annotation. 

40 (original): The process according to claim 33, wherein one of said properties is a file position 
or document position of an item on said displayed portion of said electronic information. 
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41 (original): The process according to claim 33, wherein one of said properties is a start 
identification of said displayed portion of said electronic information. 

42 (original): The process according to claim 33, further comprising the steps of: 

storing said audio annotation; and, 

searching audio annotations including said audio annotation for at least one property 
matching a query. 

43 (original): A process for playing audio annotations comprising the steps of: 

displaying a portion of electronic information; 
receiving a user input; 
retrieving audio annotations; 

assembling said audio annotations into an audio stream; and 
playing said audio stream. 

44 (original): The process according to claim 43, further comprising the step of: 

waiting for a second user input prior to playing said audio stream. 

45 (currently amended): The process according to claim 43, further comprising the step of: 

playing said audio stream once said audio stream is assembled. 

46 (original): The process according to claim 43, wherein said user input is a text query. 

47 (original): The process according to claim 43, wherein said user input is a voice query. 

48 (original): The process according to claim 43, further comprising the steps of: 

altering the display of said portion to match a currently playing annotation in said audio 

stream. 
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49 (currently amended): The process according to claim 48, wherein said altering step includes 
the steps of: 

comparing the length of said currently playing annotation with the-starting identifications 
of displayable portions of said electronic information; and 

displaying the portion of said electronic information supporting the greater length of said 
currently playing annotation. 

50 (original): A process for playing audio annotations comprising the steps of: 

navigating to a page; 

retrieving at least one audio annotation associated with a page or associated with an item 
on a page; and 

playing said at least one audio annotation. 

5 1 (original): The process according to claim 50, further comprising the step of: 

waiting for a user input prior to playing said audio annotation. 

52 (original): The process according to claim 50, wherein said item on said page includes at 
least one of embedded notes, inked notes, highlights and underlining. 

53 (original): The process according to claim 50, wherein said at least one audio annotation was 
previously retrieved and said retrieving step includes indexing said previously retrieved at least 
one audio annotation. 

54 (original): The process according to claim 50, wherein said at least one audio annotation is 
the result of a newly executed query. 

55 (original): A computer readable medium having a data structure stored thereon, said data 
structure comprising: 

a document; 

a link object; and 
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audio content with at least one property, 

wherein said link object references said document and references said audio content. 

56 (original): The data structure according to claim 55, wherein said property relates to the time 
said audio content started recording. 

57 (original): The data structure according to claim 55, wherein said property relates to the time 
said audio content stopped recording. 

58 (original): The data structure according to claim 55, wherein said property relates to the 
length of recording of said audio content. 

59 (original): The data structure according to claim 55, wherein said property relates to the 
author of the recording. 

60 (original): The data structure according to claim 55, wherein said property relates to the start 
ID. 

61 (original): The data structure according to claim 55, wherein said property relates to the stop 
ID. 

62 (original): The data structure according to claim 55, wherein said audio content is comprised 
of a plurality of audio clips. 

63 (original): The data structure according to claim 62, wherein said audio clips are stored in a 
database. 

64 (original): The data structure according to claim 55, wherein said property is one of plurality 
of properties and said properties are in a marked up language form. 

65 (original): The data structure according to claim 64, wherein said properties are in XML. 
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66 (original): The data structure according to claim 55, wherein said audio content is stored 
within a document. 

67 (original): The data structure according to claim 55, wherein said audio content is stored 
apart from a document. 

68 (original): The data structure according to claim 67, wherein said audio content is stored in a 
database with at least one property designating the position of viewed document relating to said 
audio content. 

69 (original): The data structure according to claim 67, wherein said audio content is stored in a 
database and linked to a separate annotation document that stores the position of a viewed 
document relating to said audio content. 

70 (original): A process for recording audio content comprising the steps of: 

navigating to a page of a document; 
recording said audio content; and 

associating properties with said audio content such that retrieval of said audio content 
positions said audio content after previously recorded audio content. 

71 (currently amended): The process according to claim 70, wherein said audio content 
comprises audio clips and wherein said associating st e p includ e s properties include a time 
property. 

72 (original): The process according to claim 71, wherein said audio content and said previously 
recorded audio content is ordered at least by said time property. 

73 (original): A process of searching audio clips comprising the steps of: 

inputting search terms or properties; 

searching said audio clips for said search terms or properties; and 
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ordering audio clips detected by said searching step for output. 

74 (original): The process according to claim 73, wherein said inputting step further comprises 
the steps of: 

receiving verbally delimited keywords; and 

converting said verbally delimited keywords into search terms or properties. 

75 (original): A process for recording audio information comprising the steps of: 

recording audio signals as a first file; 
processing said file to extract audio clips; and 
storing said audio clips, 

wherein said processing separates the content of said first file into audio clips based on 

events. 

76 (original): The process for recording according to claim 75, 

wherein said audio signals include speech, and 

wherein said events comprise at least one of short pauses in said speech, a pause of a 
predetermined length, and a user navigating away from a displayed page. 

77 (currently amended): A process for associating audio notes and handwritten notes comprising 
the steps of: 

creating a handwritten note; 

associating a time at which said handwritten note was created with said handwritten note; 
creating an audio note; and 

associating a time at which said audio note was created with said audio note, 
wherein, upon selection of said handwritten note, audio notes r e cord e d created at or near 
the time at which said handwritten note was created are located with said handwritten note . 

78 (original): The process according to claim 77, wherein locating said audio notes includes the 
step of querying a database for audio clips. 
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79 (original): The process according to claim 77, wherein locating said audio notes includes the 
step of searching a table. 

80 (original): The process according to claim 77, wherein locating said audio notes includes the 
step of searching a linked list. 

81 (original): The process of claim 77, wherein said audio notes are comprised of audio clips in 
which each audio clip has a time of creation associated with each audio clip. 

82 (original): The process according to claim 77, further comprising the step of: 

playing said audio notes. 

83 (original): A process for playing audio notes comprising the steps of: 

displaying a first page of electronic information; 
playing audio notes associated with said first page; 
displaying a second page of electronic information; and, 
playing audio notes associated with said second page. 

84 (original): The process according to claim 83, further comprising the step of receiving user 
input, 

wherein, in response to said user input, said second page is displayed. 

85 (original): A process of recording audio notes comprising the steps of: 

displaying a first page of electronic information; 

recording a first set of audio notes; 

associating said first set of audio notes with said first page; 

displaying a second page of electronic information; 

recording a second set of audio notes; and 

associating said second set of audio notes with said second page. 
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86 (original): The process according to claim 85, further comprising the step of receiving user 
input, 

wherein, in response to said user input, said second page is displayed. 

87 (original): A process for editing audio notes comprising the steps of: 

querying a database for audio information; 
ordering said audio information into audio notes; and 
performing editing features on said audio notes. 

88 (original): The process for editing audio notes according to claim 87, wherein said editing 
comprises at least one of the steps of: 

adding audio information; 
deleting audio information; and 
overwriting existing audio information. 
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